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Abstract 

Systems of polynomial equations over an algebraically-closed field IK can be used to concisely 
model many combinatorial problems. In this way, a combinatorial problem is feasible (e.g., a 
graph is 3-colorable, hamiltonian, etc.) if and only if a related system of polynomial equations 
has a solution over K. In this paper, we investigate an algorithm aimed at proving combinatorial 
infeasibility based on the observed low degree of Hilbert's Nullstellensatz certificates for poly- 
nomial systems arising in combinatorics and on large-scale linear-algebra computations over K. 
We report on experiments based on the problem of proving the non-3-colorability of graphs. We 
successfully solved graph problem instances having thousands of nodes and tens of thousands 
of edges. 

1 Introduction 

It is well known that systems of polynomial equations over a field can yield small models of difficult 
combinatorial problems. For example, it was first noted by D. Bayer that the 3-colorabiIity of 
graphs can be modeled via a system of polynomial equations [2]. More generally, one can easily 
prove the following: 

Lemma 1.1 The graph G is k-colorable if and only if the zero- dimensional system ofn + m equa- 
tions in n variables 

— 1 = 0, for every node i G V{G), 
^k-i _^ x'^-'^Xj + ■■■ + XixJ-^ + = 0, for every edge {i,j} G E{G), 

has a complex solution. Moreover, the number of solutions equals the number of distinct k-colorings 
multiplied by k\. 

Although such polynomial system encodings have been used to prove combinatorial results (see 
[H [5] and references within) , they have not been widely used for practical computation. The key 
issue that we investigate here is the use of such polynomial systems to effectively decide whether a 
graph, or other combinatorial structure, has a certain property captured by the polynomial system 
and its associated ideal. We call this the combinatorial feasibility problem. We are particularly 
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interested in whether this can be accompUshed in practice for large combinatorial structures such 
as graphs with many nodes. 

Certainly, using standard tools in computational algebra such as Grobner bases, one can answer 
the combinatorial feasibility problem by simply solving the system of polynomials. Nevertheless, it 
has been shown by experiments that current Grobner bases implementations often cannot directly 
solve polynomial systems with hundreds of polynomials. This paper proposes another approach that 
relies instead on the nice low degree of the Hilbert's Nullstellensatz for combinatorial polynomial 
systems and on large-scale linear-algebra computation. 

For a hard combinatorial problem (e.g., 3-colorability of graphs), we associate a system of poly- 
nomial equations J = {/i(a;) = 0, f2{x) = 0, . . . , fs{x) =0} such that the system J has a solution 
if and only if the combinatorial problem has a feasible solution. The Hilbert Nullstellensatz (see 
e.g., [3]) states that the system of polynomial equations has no solution over an algebraically-closed 
field K if and only if there exist polynomials Pi, . . . , Ps £ . . . , Xn] such that 1 = Pifi- Thus, 

if the polynomial system J has no solution, then there exists a certificate that J has no solution, 
and thus a certificate that the combinatorial problem is infeasible. 

The key idea that we explore in this article is to use the Nullstellensatz to generate a finite 
sequence of linear algebra systems, of increasing size, which will eventually become feasible if and 
only if the combinatorial problem is infeasible. Given a system of polynomial equations, we fix 
a tentative degree k for the coefficient polynomials f3i in the certificates. We can decide whether 
there is a Nullstellensatz certificate with coefficients of degree < k hy solving a system of linear 
equations over the field K whose variables are in bijection with the coefficients of the monomials 
of the polynomials Pi, . . . ,Ps- If this linear system has a solution, we have found a certificate; 
otherwise, we try a higher degree for the polynomials Pi. This process is guaranteed to terminate 
because, for a Nullstellensatz certificate to exist, the degrees of the polynomials Pi cannot be more 
than known bounds (see [8] and references therein). We explain the details of the algorithm, which 
we call NulLA, in Section [2j 

Our method can be seen as a general-field variation of work by Lasserre [9j, Laurent [llj and 
Parrilo [H] and many others, who studied the problem of minimizing a general polynomial function 
f{x) over a real algebraic variety with finitely many points. Laurent proved that when the variety 
consists of the solutions of a zero-dimensional radical ideal /, one can set up the optimization 
problem min{/(x) : x G variety (/)} as a finite sequence of semidefinite programs terminating with 
the optimal solution (see [U]). There are two key observations that speed up practical calculations 
considerably: (1) when dealing with feasibility, instead of optimization, linear algebra replaces 
semidefinite programming and (2) there are ways of controlling the length of the sequence of linear- 
algebra systems including finite field computation instead of calculations over the reals and the 
reduction of matrix size by symmetries. See Section [3] for details. 

Our algorithm has good practical performance and numerical stability. Although known the- 
oretical bounds for degrees of the Nullstellensatz coefficients are doubly-exponential in the size 
of the polynomial system (and indeed there exist examples that attain such a large bound and 
make NulLA useless in general), our experiments demonstrate that often very low degrees suffice 
for systems of polynomials coming from graphs. We have implemented an exact-arithmetic linear 
system solver optimized for these Nullstellensatz-based systems. We performed many experiments 
using NulLA, focusing on the problem of deciding 3-colorability of graphs (note that the method 
is applicable to any combinatorial problem as long as we know a polynomial system that encodes 
it). We conclude with a report on these experiments in Section 21 
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2 The Nullstellensatz Linear Algebra (NulLA) Algorithm 



Recall that Hilbert's Nullstellensatz states that a system of polynomial equations = 0, f2ix) = 

0, fs{x) = 0, where fi G ^[xi, . . . , Xn] and IC is an algebraically closed field, has no solution in 
K" if and only if there exist polynomials Pi, . . . , f3s S K[xi, . . . , Xn] such that 1 = X] Pifi The 
polynomial identity 1 = '^Pifi is called a Nullstellensatz certificate. We say a Nullstellensatz 
certificate has degree d if max{deg(/3j)} = d. 

The Nullstellensatz Linear Algebra (NulLA) algorithm takes as input a system of polynomial 
equations and outputs either a yes answer, if the system of polynomial equations has a solution, or a 
no answer, along with a Nullstellensatz infeasibility certificate, if the system has no solution. Before 
stating the algorithm in pseudocode, let us completely clarify the connection to linear algebra. 
Suppose for a moment that the polynomial system is infeasible over IC and thus there must exist 
a Nullstellensatz certificate. Assume further that an oracle has told us the certificate has degree 
d but that we do not know the actual coefficients of the degree d polynomials Pi. Thus, we have 
the polynomial identity 1 = Pifi- If we expand the identity into monomials, the coefficients of a 
monomial are linear expressions in the coefficients of the Pi. Since two polynomials over a field are 
identical precisely when the coefficients of corresponding monomials are identical, from the identity 
1 = ^ Pifi, we get a system of linear equations whose variables are the coefficients of the Pi. Here 
is an example: 

Example 2.1 Consider the polynomial system — 1 = 0,xi + X2 = 0,xi + X3 = 0, X2 + X3 = 0. 
Clearly this system has no complex solution, and we will see that it has a Nullstellensatz certificate 
of degree one. 

1 = (cqXi + C1X2 + C2X3 + C3) (xj - 1) + (C4X1 + C5X2 + C6X3 + C7) (xi + X2) 



Pi h f2 

+ {csXi + C9X2 + C10X3 + Cii) {Xi + X3) + (ci2Xi + C13X2 + 014X3 + C15) (X2 + X3) . 

A /3 /34 /4 

Expanding the tentative Nullstellensatz certificate into monomials and grouping like terms, we 
arrive at the following polynomial equation: 

1 = CQxf + C1X1X2 + C2xlx3 + (C3 + C4 + C8)xl + (cs + Ci3)x2 + (cio + Ci4)x3 + 

(C4 + C5 + Cg + Ci2)xiX2 + (cq + Cg + Cio + Ci2)xiX3 + (ce + Cg + C13 + Ci4)x2X3 + 
(C7 + Cii - Co)xi + (C7 + Ci5 - Ci)x2 + (cn + Ci5 - 02)^3 - C3. 

From this, we extract a system of linear equations. Since a Nullstellensatz certificate is identically 
one, all monomials except the constant term must be equal to zero; namely: 

Co = 0, ci = 0, . . . , C3 + C4 + C8 = 0, Cn + ci5 - C2 = 0, -C3 = 1. 

By solving the system of linear equations, we reconstruct the Nullstellensatz certificate from the 
solution. Indeed 

1 = (-l)(Xi - 1) + ^Xi{xi + X2) - ^Xl{x2 + X3) + ^Xl{xi + X3) 

Now, of course in general, one does not know the degree of the Nullstellensatz certificate in 
advance. What one can do is to start with a tentative degree, say start at degree one, produce 
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the corresponding linear system, and solve it. If the system has a solution, then we have found a 
Nullstellensatz certificate demonstrating that the original input polynomials do not have a common 
root. Otherwise, we increment the degree until we can be sure that there will not be a Nullstellensatz 
certificate at all, and thus we can conclude the system of polynomials has a solution. The number of 
iterations of the above steps determines the running time of NulLA. For this, there are well-known 
upper bounds on the degree of the Nullstellensatz certificate [8] . These upper bounds for the degrees 
of the coefficients Pi in the Hilbert Nullstellensatz certificates for general systems of polynomials 
are doubly-exponential in the number of input polynomials and their degree. Unfortunately, these 
bounds are known to be sharp for some specially-constructed systems. Although this immediately 
says that NulLA is not practical for arbitrary polynomial systems, we have observed in practice that 
polynomial systems for combinatorial questions are extremely specialized, and the degree growth 
is often very slow — enough to deal with large graphs or other combinatorial structures. Now we 
describe NulLA in pseudocode: 

ALGORITHM (Nullstellensatz Linear Algebra (NulLA) Algorithm) 

INPUT: A system of polynomial equations F = {fi{x) = 0, . . . , /^(x) =0} 

OUTPUT: YES, if F has solution, else NO with a Nullstellensatz certificate of infeasibility. 

Set d^l. 

Set K equal to the known upper bounds on degree of Nullstellensatz for F (see e.g., [8]) 
while d < K do 

CERT ^ ^2^=1 Pifi (where (3i are polynomials of degree d, 

with unknowns for their coefficients). 
Extract a system of linear equations from cert with columns corresponding to unknowns, 

and rows corresponding to monomials. 
Solve the linear system, 
if the linear system is consistent then 

CERT <— Pifi (with unknowns in (3i replaced with linear system solution values.) 

print "The system of equations F is infeasible." 

return NO with cert. 
else 

Set d:=d+l. 
end if 
end while 

print "The system of equations F is feasible." 
return yes. 

This opens several theoretical questions. It is natural to ask about lower bounds on the degree 
of the Nullstellensatz certificates. Little is known, but recently it was shown in [5], that for the 
problem of deciding whether a given graph G has an independent set of a given size, a minimum- 
degree Nullstellensatz certificate for the non-existence of an independent set of size greater than 
a{G) (the size of the largest independent set in G) has degree equal to a(G), and it is very dense; 
specifically, it contains at least one term per independent set in G. For polynomial systems coming 
from logic there has also been an effort to show degree growth in related polynomial systems (see 
O [6] and the references therein). Another question is to provide tighter, more realistic upper 
bounds for concrete systems of polynomials. It is a challenge to settle it for any concrete family of 
polynomial systems. 
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3 Four mathematical ideas to optimize NulLA 



Since we are interested in practical computational problems, it makes sense to explore refinements 
and variations that make NulLA robust and much faster for concrete challenges. The main com- 
putational component of NulLA is to construct and solve linear systems for finding Nullstellensatz 
certificates of increasing degree. These linear systems are typically very large for reasonably-sized 
problems, even for certificate degrees as low as four, which can produce linear systems with millions 
of variables (see Section Furthermore, the size of the linear system increases dramatically with 
the degree of the certificate. In particular, the number of variables in the linear system to find a 
Nullstellensatz certificate of degree d is precisely where n is the number of variables in the 

polynomial system and s is the number of polynomials. Note that ("'^'^) is the number of possible 
monomials of degree d or less. Also, the number of non-zero entries in the constraint matrix is 
precisely M(^~j^'^^ where M is the sum over the number of monomials in each polynomial of the 
system. 

For this reason, in this section, we explore mathematical approaches for solving the linear system 
more efficiently and robustly, for decreasing the size of the linear system for a given degree, and 
for decreasing the degree of the Nullstellensatz certificate for infeasible polynomial systems thus 
significantly reducing the size of the largest linear system that we need to solve to prove infeasibility. 
Note that these approaches to reduce the degree do not necessarily decrease the available upper 
bound on the degree of the Nullstellensatz certificate required for proving feasibility. 

It is certainly possible to significantly decrease the size of the linear system by preprocessing 
the given polynomial system to remove redundant polynomial equations and also by preprocessing 
the linear system itself to eliminate many variables. For example, in the case of 3-coloring problems 
for connected graphs, since {xf + 1) = (x| + 1) + (xj + Xj){xf + XiXj + xj), we can remove all but 
one of the vertex polynomials by tracing paths through the graph. However, preprocessing alone 
is not sufficient to enable us to solve some large polynomial systems. 

The mathematical ideas we explain in the rest of this section can be applied to arbitrary 
polynomial systems for which we wish to decide feasibility, but to implement them, one has to look 
for the right structures in the polynomials. 

3.1 NulLA over Finite Fields 

The first idea is that, for combinatorial problems, one can often carry out calculations over finite 
fields instead of relying on unstable floating-point calculations were we to be working over the reals 
or complex numbers. We illustrate this with the problem of deciding whether the vertices of a graph 
permit a proper 3-coloring. The following encoding (a variation of [2j over the complex numbers) 
allows us to compute over F2, which is robust and much faster in practice: 

Lemma 3.1 The graph G is 3- colorable if and only if the zero- dimensional system of equations 

X? + 1 = 0, for every node i G V{G), 
xf + XiXj + x| = 0, for every edge {i,j} G E{G) , 

has a solution over ¥2, the algebraic closure of ¥2. 

Before we prove Lemma l3. 11 we introduce a convenient notation: Let a be an algebraic element 
over F2 such that + a + 1 = 0. Thus, although x? + 1 has only one root over F2, since 
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+ 1 = {xi + l){xf + Xi + 1), the polynomial xf + 1 has three roots over F2, which are 1, a and 
a + 1. 

Proof: If the graph G is 3-colorable, simply map the three colors to l,a and a + 1. Clearly, the 
vertex polynomial equations + 1 = are satisfied. Furthermore, given an edge {i,j}, Xi + Xj 7^ 
since variable assignments correspond to a proper 3-coloring and adjacent vertices are assigned 
different roots. This implies that x^ -\- x^ = (xj + Xj){xf + XiXj + x'j) = 1 + 1 = 0. Therefore, 
xf + XiXj + xj = and the edge polynomial equations are satisfied. 

Conversely, suppose that there exists a solution to the system of polynomial equations. Clearly, 
every vertex is assigned either l,a or a + 1. We will show that adjacent vertices are assigned 
different values. Our proof is by contradiction: Assume that two adjacent vertices i,j are assigned 
the same value f3. Then, = + x-ixj + xj = + + = 3/3^ 7^ 0. Therefore, adjacent 
vertices are assigned different roots, and a solution to the system corresponds directly to a proper 
3-coloring. □ 

We remark that this result can be extended to fc-colorability and Fg, when q is relatively prime 
to k. The following computational lemma will allow us to certify graph non-3-colorability very 
rapidly over F2 instead of working over its algebraic closure. 

Lemma 3.2 Let M. be a field and IC its algebraic closure. Given /i, /2, . . . , /s G ]K[xi, . . . , there 
exists a Nullstellensatz certificate 1 = "^Pifi where (3i £ K[xi, . . . ,x„] if and only if there exists a 
Nullstellensatz certificate 1 = YK^ifi where j3[ S . . . 

Proof: If there exists a Nullstellensatz certificate 1 = ^Pifi where Pi £ K[xi, . . . , x„], via 
NulLA, construct the associated linear system and solve. Since fi £ K[xi, . . . ,Xn], the coefficients 
in the linear system will consist only of values in K. Thus, solving the linear system relies only 
on computations in K, and if the free variables are chosen from K instead of K, the resulting 
Nullstellensatz certificate 1 = X] A'/j P'i ^ ^[xi, ■ ■ ■ , Xn]- The reverse implication is trivial. □ 

Therefore, we have the following corollary: 

Corollary 3.3 A graph G is non- 3- colorable if and only if there exists a Nullstellensatz certificate 
1 = ^Pifi where f3i £ ¥2[xi, . . . , Xn] where the polynomials fi £ F2[xi, . . . , Xn] are as defined in 
Lemma \3.1\ 

This corollary enables us to compute over F2, which is extremely fast in practice (see Section 

ED. 

Finally, the degree of Nullstellensatz certificates necessary to prove infeasibility can be lower 
over F2 than over the rationals. For example, one can prove that over the rationals, every odd- 
wheel has a minimum non-3-colorability certificate of degree four [5]. However, over F2, every 
odd-wheel has a Nullstellensatz certificate of degree one. Therefore, not only are the mathematical 
computations more efficient over F2 as compared to the rationals, but the algebraic properties of 
the certificates themselves are sometimes more favorable for computation as well. 

3.2 NulLA with symmetries 

Let us assume that the input polynomial system F = {/i, . . . , fg} has maximum degree q and that 
n is the number of variables present. As we observed in Section [2l for a given fixed positive integer 
d serving as a tentative degree for the Nullstellensatz certificate, the Nullstellensatz coefficients 
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come from the solution of a system of linear equations. We now take a closer look at the matrix 
equation Mp^y = bp^d defining the system of linear equations. First of all, the matrix Mp^d has 
one row per monomial x° of degree less than or equal to g + d on the n variables and one column 
per polynomial of the form fi, i.e., the product of a monomial of degree less than or equal to 
d and a polynomial fi G F. Thus, Mp^^ = (M^a^^Sf.) where M^a^^Sf. equals the coefficient of the 
monomial in the polynomial x^ fi. The variable y has one entry for every polynomial of the form 
x^fi denoted y^s j. , and the vector bp^^ has one entry for every monomial x" of degree less than or 
equal to q + d where {bp^d)x<^ = if a / and = 1- 

Example 3.4 Consider the complete graph The shape of a degree-one Hilbert Nullstellensatz 
certificate over F2 for non-3-color ability is as follows: 

1 = co{xl + 1) 

+ {0X2X1 + c\2X2 + c\2Xz + c\2Xa){x\ + X1X2 + X2) + (cJgXi + c\3X2 + C^gXa + c\^Xa){x\ + XiX'i + x%) 
+ {c\iXi + c\^X2 + c\^Xz + c\^Xi){x\ + XiX^ + x1) + {c\.^Xi + c\^X2 + C23.T3 + c\^Xi){x\ + X2X3 + xl) 

+ (C24X1 + €34X2 + €34X3 + C24Xi){xl + X2XA + x\) + (€34X1 + 034X2 + 2342:3 + C34a;4)(a;3 + a::3a;4 + xl) 

Note that we have preprocessed the certificate by removing the redundant polynomials + 1 where 
i 7^ 1 and removing some variables that we know a priori can be set to zero, which results in a 
matrix with less columns. As we explained in Section [21 this certificate gives a linear system of 
equations in the variables cq and c^- (note that /c is a superscript and not an exponent). This linear 
system can be captured as the matrix equation Mp^ic = bp^i where the matrix Mp^i is as follows. 
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Certainly the matrix Mp^d is rather large already for small systems of polynomials. The main 
point of this section is to demonstrate how to reduce the size of the matrix by using a group action 
on the variables, e.g., using symmetries or automorphisms in a graph. Suppose we have a finite 
permutation group G acting on the variables xi, . . . ,Xn- Clearly G induces an action on the set of 
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monomials with variables xi,X2, ■ ■ ■ ,Xn of degree t. We will assume that the set F of polynomials 
is invariant under the action of G, i.e., g{fi) G F for each fi € F. Denote by x^, the monomial 
xl^X2^ . . . x^, a monomial of degree 5i + 82 + ■ ■ ■ + 6^- Denote by Or6(x"), Orb{x^ fi) the orbit 
under G of monomial and, respectively, the orbit of the polynomial obtained as the product of 
the monomial x^ and the polynomial /, G F. 

We now introduce a new matrix equation Mp^ct,G V = ^F,d,G- The rows of the matrix MF,d,G 
indexed by the orbits of monomials Orb{x"') where .t° is a monomial of degree less than or equal to 
q + d, and the columns of Mpi^ Q are indexed by the orbits of polynomials Orb{x^ fi) where fi £ F 
and the degree of the monomial x^ less than or equal to d. Then, let MF,d,G = {^Orb{x<='),Orb(x^ fi)) 
where 

^Orb{x"),Orb{x^}i) = Mx",xifj- 

xi fj(iOrb{x^ fi) 

Note that M^a^^sj^. = Mg^^^a-^^g^^^s ^.^ for all 5 G G meaning that the coefficient of the monomial in 
the polynomial x^fi is the same as the coefficient of the monomial 5(2;") in the polynomial g{x^ fi). 
So, 

51 M^«,a;7/^ = 51 M^d,^^_^. for allx''GOr6(x"), 

xtfjeOrb{x^fi) xtfjeOrb{x^fi) 

and thus, MQj.^^a^^Orb{x^ fi) is well-defined. We call the matrix Mf4,g the orhit matrix. The 
variable y has one entry for every polynomial orbit Orb{x^ fi) denoted yorb{x^fi)- The vector bp^i 
has one entry for every monomial orbit Orb{x'^), and let {bF,d)orb{x") = {bF,d)x'^ = if a 7^ and 
(bF,d)orb{i) = = 1- The main result in this section is that, under some assumptions, the 

system of linear equations MF,d,G V = bF,d,G has a solution if and only if the larger system of linear 
equations Mp^dU = bF,d has a solution. 

Theorem 3.5 LetK. be an algebraically-closed field. Consider a polynomial system F = {/i, . . . , fg} 
C K[xi, . . . ,Xn] and a finite group of permutations G G Sn- Let Mp^d, MF,d,G denote the matrices 
defined above. Suppose that the polynomial system F is closed under the action of the group G 
permuting the indices of variables xi, . . . Suppose further that the order of the group \G\ and 
the characteristic of the field K are relatively prime. The degree d Nullstellensatz linear system 
of equations Mp^dV = has a solution over IK if and only if the system of linear equations 
^F,d,Gy = bp^fi,G has a solution over K. 

Proof: To simplify notation, let M = Mp^^, b = bp^d, M = Mp^d,G and b = bp^d,G- First, we show 
that if the linear system My = b has a solution, then there exists a symmetric solution y of the 
linear system My = b meaning that y^sj. is the same for all x^ fi in the same orbit, i.e., yxffj = Ux^fi 
for all x^fj G Orb{x^fi). The converse is also trivially true. 

Since the rows and columns of the matrix M are labeled by monomials and polynomials x^ fi 
respectively, we can also think of the group G as acting on the matrix M, permuting the entries of 
M, where g{M)g^^c)^g(^^s f.) = M^c^^Sf.. Moreover, since M^a^^Sf. = Mg,^^a)^gi^^6 f.) for all 5 G G, we 
must have g{M) = M, so the matrix M is invariant under the action of the group G. Also, since 
the entries of the variable y are labeled by polynomials of the form x°'fi, we can also think of the 
group G as acting on the vector y, permuting the entries of the vector y, i.e., applying g E G to y 
gives the permuted vector g{y) where g{y)g[x^f{) = Vx^fi- Similarly, G acts on the vector b, and in 
particular, g{b) = b. Next, we show that if My = b, then Mg{y) = b for all g E G. This follows 
since 

My = b =^ g{My) = g{b) => g{M)g{y) = b Mg{y) = 6, 
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for all g e G. Now, let 

' ' geG 

Note we need that |G| is relatively prime to the characteristic of the field K. so that |G| is invertible. 
Then, 

so y' is a solution. Also, y'^gj,^ = Egec y<?(x*/,)' y'^Sf^ = v'^if^ foi^ all x^fj G Orb{x^fi). 
Therefore, y' is a symmetric solution as required. 

Now, assume that there exists a solution of My = b. By the above argument, we can assume 
that the solution is symmetric, i.e., = Uxtfj where g{x^fi) = x'^fj for some g E G. From this 
symmetric solution of My = b, we can find a solution of My = 6 by setting 

yOrb(x^h) = Vx^U- 

To show this, we check that {My)orb(x") = borb{x^) for every monomial x". 

{My)orb{x'^) = ^x°',Orb{x^fi) VOrbix^ f,) 

all Orb(x^f,) 

a\\ Orb{x^f,) \xrifj£Orb{x^f,) / 

= ^ ( Yl Mx^,x^f,yxVj 

all Or6(a;*/j) eOr6(x*/,) 

= ^ ^x°-,x^f,yx^fi 
all 

Thus, {My)orb(x") = borb{x") since {My)^^ = b^c. = borbix^)- 

Next, we establish the converse more easily. Recall that the columns of M are labeled by orbits. 
If there is a solution for My = b, then to recover a solution of My = b, we set 

Vx^f, = VOrb(x^fi)- 

Note that y is a symmetric solution. Using the same calculation as above, we have that {My)x<^ = 
{My)Q^lj(^^a-^, and thus. My = b. □ 

Example 3.6 (Continuation of Example 13. 4|) Now consider the action of the symmetry group 
G generated by the cycle (2,3,4) (a cyclic group of order three). The permutation of variables 
permutes the monomials and yields a matrix Mp^i^Q. We have now grouped together monomials 
and terms within orbit blocks in the matrix below. The blocks will be later replaced by a single 
entry, shrinking the size of the matrix. 
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Co 


1 I 1 
'^12 '^13 '^14 


r.^ ^0 „4 

''12 ''13 ''14 


^0 „4 

''12 ''13 '-14 


■4 2 
•^12 '^13 ''14 


1 I 1 
'^23 ''34 '^24 


r.^ ^0 ^4 

'-23 ''34 ''24 


T a^ 

r-^ ^0 „4 

''24 ''23 '-34 


^ a^ 

r-^ ^0 „4 

''34 ^24 '-23 


1 


1 


























x'f 


1 


111 























X{X2 

X\X3. 
2 







1 
1 
1 


1 
1 
1 


1 

1 
1 


1 

1 

1 






















X1X2 

xix\ 
2 

X\X^ 







10 
1 
1 


1 
1 
1 












1 1 
1 1 
1 1 

















X1X2X3 
X1X2X4, 
XIX3X4 

















1 
1 
1 


1 

1 
1 


1 
1 
1 

















X2 
xl 

X4 












1 
1 
1 

















1 
1 
1 


1 
1 
1 







2 

X^X4: 

X2XI 

















1 
1 
1 












1 
1 
1 


1 

1 

1 


1 

1 

1 


X^X4: 

X2XI 

xsxl 






















1 
1 
1 







1 

1 
1 


1 
1 
1 


1 

1 
1 


X2XzXa 


























1 1 1 



The action of the symmetry group generated by the cycle (2,3,4) yields an orbit matrix Mp^q^c 
of about a third the size of the original one: 





Co 


C12 


C12 


C12 


C12 


C23 


C23 


C24 


C34 






Co 


C12 


'-12 


'-12 


'-12 


C23 


C23 


C24 


C34 


Orb{l) 


1 




























Orb{l) 


1 


























Orb{x'i) 


1 


3 

























Orb{x'i) 


1 


1 























Orb{x(x2) 





1 


1 


1 


1 
















Orb{x'(x2) 





1 


1 


1 


1 














Orb{xiX2) 





1 


1 








2 











(mod 2) 


Orb{xiX2) 





1 


1 




















Orb{xiX2X3) 











1 


1 


1 













Orb{xiX2X3) 











1 


1 


1 











Orb{x^) 








1 











1 


1 







Orb{xi) 








1 











1 


1 





Orb{x2X3) 











1 








1 


1 


1 




Orb{x2X3) 











1 








1 


1 


1 


Orb{x2Xi) 














1 





1 


1 


1 




Orb{x2Xi) 














1 





1 


1 


1 


Orb{x2X3Xi) 


























3 




Orb{x2X3X4) 


























1 



If |G| is not relatively prime to the characteristic of the field IK, then it is still true that, if 
My = b has a solution, then My = b has a solution. Thus, even if |G| is not relatively prime to 
the characteristic of the field IC, we can still prove that the polynomial system F is infeasible by 
finding a solution of the linear system My = b. 

3.3 Reducing the Nullstellensatz degree by appending polynomial equations 

We have discovered that by appending certain valid but redundant polynomial equations to the 
system of polynomial equations described in Lemma |3. 11 we have been able to decrease the degree 
of the Nullstellensatz certificate necessary to prove infeasibility. A valid but redundant polynomial 
equation is any polynomial equation g(x) = that is true for all the zeros of the polynomial 
system = 0, ...,/s(x) = 0, i.e., g G \/7, the radical ideal of /, where / is the ideal generated 

by /i,...,/s. Technically, we only require that g{x) = holds for at least one of zeros of the 
polynomial system = 0, ...,/s(x) = if a zero exists. We refer to a redundant polynomial 
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equation appended to a system of polynomial equations, with the goal of reducing the degree of a 
Nullstellensatz certificate, degree- cutter. 

For example, for 3-coloring, consider a triangle described by the vertices {x,y,z}. Whenever a 
triangle appears as a subgraph in a graph, the vertices of the triangle must be colored differently. 
We capture that additional requirement with the equation 

x'^ + y^ + z^ = 0, (1) 

which is satisfied if and only iix^y^z^x since x, y and z are third roots of unity. Note that the 
equation x -\-y -\- z = also implies x / y / z 7^ x, but we use the equation x^ + + = 0, which 
is homogeneous of degree two, because the edge equations from Lemma 13.11 are also homogeneous 
of degree two, and this helps preserve the balance of monomials in the final certificate. 

Consider the Koester graph [7J from Figure [H a graph with 40 vertices and 80 edges. This 
graph has chromatic number four, and a corresponding non-3-colorability certificate of degree four. 
The size (after preprocessing) of the associated linear system required by NulLA to produce this 
certificate was 8, 724, 468 x 10, 995, 831 and required 5 hours and 17 minutes of computation time. 




Figure 1: Koester graph [7] 



When we inspect the Koester graph in Figure [H we can see that this graph contains 25 triangles. 
When we append these additional 25 equations to the system of polynomial equations describing 
this graph, the degree of the Nullstellensatz certificate drops from four to one, and now, with the 
addition of the 25 triangle equations, NulLA only needs to solve a 4, 626 x 4, 346 linear system 
to produce a degree one certificate, which takes 0.2 seconds of computation time. Note that even 
though we have appended equations to the system of polynomial equations, because the degree of 
the overall certificate is reduced, the size of the resulting linear system is still much, much less. 

These degree-cutter equations for 3-colorability ([T|) can be extended to A:-colorability. A (k — 1)- 
clique implies that all nodes in the clique have a different color. Then, given the (A; — l)-clique with 
the vertices {xi,X2, ...,Xfc_i}, the equation Xi~^ + x^^ + ... + = is valid. We conjecture 
that these equations may also decrease the minimal degree of the Nullstellensatz certificate if one 
exists. 

The degree-cutter equations for 3-colorability ([T]) are not always sufficient to reduce the de- 
gree of the Nullstellensatz. Consider the graph from Figure [2j Using only the polynomials from 
Lemma 13.11 the graph in Figure [2] has a degree four certificate. The graph contains three trian- 
gles: {1, 2, 6}, {2, 5, 6} and {2,6,7}. In this case, after appending the degree-cutter equations for 
3-colorability the degree of the minimal Nullstellensatz certificate for this graph is still four. 
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Figure 2: A graph with a degree four certificate. 



The difficulty with the degree-cutter approach is in finding candidate degree-cutters and in 
determining how many of the candidate degree-cutters to append to the system. There is an 
obvious trade-off here between the time spent finding degree-cutters together with the time penalty 
incurred related to the increased size of the linear system that must be solved versus the benefit of 
reducing the degree of the Nullstellensatz certificate. 

3.4 Alternative Nullstellensatze 

There is another approach we have found to decrease the minimal degree of the Nullstellensatz 
certificate. We now introduce the idea of an alternative Nullstellensatz, which follows from the 
Hilbert Nullstellensatz. 

Corollary 3.7 (Alternative Nullstellensatz) A system of polynomial equations fi{x) = 0, . . . , 
fs{x) = where fi £ . . . , Xn] and K is an algebraically closed field has no solution in if and 

only if there exist polynomials (3i, . . . , (3s G K[xi, . . . , Xn] and g G ]K[a;i, x„] such that g = Pifi 
and the system fi{x) = 0, . . . , fs{x) = and g{x) = has no solution. 

The Hilbert Nullstellensatz is a special case of this alternative Nullstellensatz where g{x) = 1. We 
can easily adapt the NulLA algorithm to use this alternative Nullstellensatz given the polynomial 
g. Here, the polynomial g determines the constant terms of the linear system that we need to solve 
to find a certificate of infeasibility. The idea here is that the minimal degree of the alternative Null- 
stellensatz certificate is sometimes smaller than the minimal degree of the ordinary Nullstellensatz 
certificate. 

In the case of 3-colorability (and also more generally A;-colorability) , we may choose g as any 
non-trivial monomial since g{x) = implies that Xj = for some i = which contradicts 

that X? — 1 = 0. For the graph in Figure [21 if we choose g{x) = xix%xg, then the minimal degree 
of the Nullstellensatz certificate is now one. The actual certificate is as follows: 

a;ia:8a;9 = {xi + X2){xl + xiX2 + x^) + [x^ + xg + xi2){xl + xiXa + xl) 

+ {Xi + X4 + X%){x\ + XiXi2 + X^j) + [X2 + X-i + Xfi){x1 + X2X3 + X3) 

+ {X5){xl + X2X5 + xl) + (Xs + Xs){xl + X2X7 + xi,) + {X2 + 2:7 + Xfi){x\ + X^iX^ + x\) 
+ {Xx + 2:4 + Xxq){x\ + X^Xq + .Xg) + (Xio + Xx2){x\ + X^Xxx + x\^ 

+ (x2 + a;io)(a;5 + xs^e + Xg) + (.xs + 2:10) (2:5 + xr^xo, + x\) 
+ {x2 + xxq){x\ + XiiX-j + xi,) + (2:5 + x-!){x\ + .Xe-TlO + x{f^) 

+ {X2 + X3 + Xi2){Xj + X7XS + xl) + (Xio + X12){X7 + XjXii + X^^) + {xi){xl + XgXg + Xg) 
+ {xi +Xj + Xs)ixl + XsXi2 + XI2) + {xi + X^){xl + XgXio + x\q) 

+ {xi + x-!){x\q + xioxii + xl-^) + {xi + x-!){xl-^ + Xiia;i2 + 0:^2) + (2:5 + X7){xl + X2Xq + xl) 
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+ {X8 + Xg) {xj + xl + xl) +(X9) {xl + xl + xl) +{xs) {xl + Xg + X7) . 

, ■' ^ , ' „ ■' 

dcgicc-cutter dcgrcc-cutter dcgrcc-cutter 

Note that we used the degree-cutter equations ([T]) to obtain a certificate of degree one. Also, 
note that the monomial xiXgXg was not the only monomial we found that gave a Nullstellensatz 
certificate of degree one. 

The apparent difficulty in using the alternative Nullstellensatz approach is in choosing g{x). One 
solution to this problem is to try and find a Nullstellensatz certificate for a set of g{x) including 
g{x) = 1. For example, for the graph in Figure [21 we tried to find a certificate of degree one for the 
set of all possible monomials of degree 3. Since choosing different g{x) only means changing the 
constant terms of the linear system in NulLA (the other coefficients remain the same), solving for 
a set of g{x) can be accomplished very efficiently. 

4 Experimental results 

In this section, we present our experimental results. To summarize, almost all of the graphs tested 
by NulLA had degree one certificates. This algebraic property, coupled with our ability to compute 
over F2, allowed us to prove the non-3-colorability of graphs with over a thousand nodes. 

4.1 Methods 

Our computations were performed on machines with dual Opteron nodes, 2 GHz clock speed, and 
12 GB of RAM. No degree-cutter equations or alternative Nullstellensatz certificates were used. 
We preprocessed the linear systems by removing redundant vertex polynomials via (xf + 1) = 
(x^ -|- 1) -|- {xi + Xj){xf + XiXj + xj). Since the graphs that we tested are connected, using the 
equation (x? + 1) = (x^ + 1) + (xj -|- Xj){xf + XiXj + xj), we can remove all but one of the 
vertex polynomial equations by tracing paths from an arbitrarily selected "origin" vertex. We also 
eliminated unnecessary monomials from the system. 

4.2 Test cases 

We tested the following graphs: 

1. DIMACS: The graphs from the DIMACS Computational Challenge (1993, 2002) are de- 
scribed in detail at http://mat.gsia.cmu.edu/C0L0RING02/, This set of graphs is the stan- 
dard benchmark for graph coloring algorithms. We tested every DIMACS graph whose asso- 
ciated NulLA matrix could be instantiated within 12 GB of RAM. For example, we did not 
test C4000 . 5 . clq, which has 4,000 vertices and 4,000,268 edges, yielding a degree one NulLA 
matrix of 758 million non-zero entries and 1 trillion columns. 

2. Mycielski: The Mycielski graphs are a classic example from graph theory, known for the 
gap between their clique and chromatic number. The Mycielski graph of order is a triangle- 
free graph with chromatic number k. The first few instances and the algorithm for their 
construction can be seen at http://mathworld.wolfram.com/MycielskiGraph.html, 

3. Kneser: The nodes of the Kneser-(t, r) graph are represented by the r-subsets of {1, . . . ,t}, 
and two nodes are adjacent if and only if their subsets are disjoint. 
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4. Random: We tested random graphs in 16 nodes with an edge probabihty of .27. This 
probabiUty was experimentally selected based on the boundary between 3-colorable and non- 
3-colorable graphs and is explained in detail in Section 14.31 

4.3 Results 

In this section, we present our experimental results on graphs with and without 4-cliques. We 
also compare NulLA to other graph coloring algorithms, point out certain properties of NulLA- 
constructed certificates, and conclude with tests on random graphs. Surprisingly, all but four of 
the DIMACS, Mycielski and Kneser graphs tested with NulLA have degree one certificates. 

The DIMACS graphs are primarily benchmarks for graph fc-colorability, and thus contain many 
graphs with large chromatic number. Such graphs often contain 4-cliques. Although testing for 
graph 3-colorability is well-known to be NP-Complete, there exist many efficient (and even trivial), 
polynomial-time algorithms for finding 4-cliques in a graph. Thus, we break our computational 
investigations into two tables: Table [T] contains graphs without 4-cliques, and Table H] contains 
graphs with 4-cliques (considered "easy" instances of 3-colorability). For space considerations, we 
only display representative results for graphs of varying size for each family. 



Graph 


vertices 


edges 


rows 


cols 


deg 


sec 


m7 (Mycielski 7) 


95 


755 


64,281 


71,726 


1 


.46 


m9 (Mycielski 9) 


383 


7,271 


2,477,931 


2,784,794 


1 


268.78 


mlO (Mycielski 10) 


767 


22,196 


15,270,943 


17,024,333 


1 


14835 


(8, 3)-Kneser 


56 


280 


15,737 


15,681 


1 


.07 


(10,4)-Kneser 


210 


1,575 


349,651 


330,751 


1 


3.92 


(12, 5)-Kneser 


792 


8,316 


7,030,585 


6,586,273 


1 


466.47 


(13, 5)-Kneser 


1,287 


36,036 


45,980,650 


46,378,333 


1 


216105 


ashSaiGPIA.col 


662 


4,185 


3,147,007 


2,770,471 


1 


13.71 


ash608GPIA.col 


1,216 


7,844 


10,904,642 


9,538,305 


1 


34.65 


ash958GPIA.col 


1,916 


12,506 


27,450,965 


23,961,497 


1 


90.41 


l-Insertions_5 . col 


202 


1,227 


268,049 


247,855 


1 


1.69 


2-Insertions_5.col 


597 


3,936 


2,628,805 


2,349,793 


1 


18.23 


3-Insertions_5 . col 


1,406 


9,695 


15,392,209 


13,631,171 


1 


83.45 



Table 1: Graphs without 4-cliques. 

We also compared our method to well-known graph coloring heuristics such as DSATUR and 
Branch- and- Cut |lUj . These heuristics return bounds on the chromatic number. In Table [2] (data 
taken from [10]), we display the bounds returned by Branch- and- Cut (B&C) and DSATUR, respec- 
tively. In the case of these graphs, NulLA determined non-3-colorability very rapidly (establishing a 
lower bound of four), while the two heuristics returned lower bounds of three and two, respectively. 
Thus, NulLA returned a tighter lower bound on the chromatic number than B&C or DSATUR. 

However, not all of the DIMACS challenge graphs had degree one certificates. We were not 
able to produce certificates for mug88_l . col, mug88_25 . col, muglOO_l . col or mugl00_25 . col, even 
when using degree-cutters and searching for alternative Nullstellensatz certificates. When testing 
for a degree four certificate, the smallest of these graphs (mug88_l . col with 88 vertices and 146 
edges) yielded a linear system with 1,170,902,966 non-zero entries and 390,340,149 columns. A 
matrix of this size is not computationally tractable at this time. 

Recall that the Nullstellensatz certificates returned by NulLA consist of a single vertex polyno- 
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B&C 


DSATUR 


NulLA 


Graph 


vertices 


edges 


lb 


up 


lb 


up 


deg 


sec 


4-Insertions_3.col 


79 


156 


3 


4 


2 


4 


1 





3-Insertions_4 . col 


281 


1,046 


3 


5 


2 


5 


1 


1 


4-Insertions_4.col 


475 


1,795 


3 


5 


2 


5 


1 


3 


2-Insertions_5.col 


597 


3,936 


3 


6 


2 


6 


1 


12 


3-Insertions_5.col 


1,406 


9,695 


3 


6 


2 


6 


1 


83 



Table 2: NulLA compared to Branch-and-Cut and DSATUR. 



mial (via preprocessing), and edge polynomials describing either the original graph in its entirety, 
or a non-3-colorable subgraph from the original graph. For example, if the graph contains a 4- 
clique as a subgraph, often the Nullstellensatz certificate will only display the edges contained in 
the 4-clique. Thus, we say that NulLA isolates a non-3-colorable subgraph from the original graph. 
The size difference between these subgraphs and the input graphs is often dramatic, as shown in 
Table [3l 



Graph 


vertices 


edges 


subgraph 

vertices 


subgraph 

edges 


milesl500.col 


128 


10,396 


6 


10 


hamming8-4 . clq 


256 


20,864 


19 


33 


mlO (Mycielski 10) 


767 


22,196 


11 


20 


(12, 5)-Kneser 


792 


8,316 


53 


102 


dsjclOOO.l.col 


1,000 


49,629 


15 


24 


ash608GPIA.col 


1,216 


7,844 


23 


44 


3-Insertions_5.col 


1,406 


9,695 


56 


110 


ash958GPIA.col 


1,916 


12,506 


24 


45 



Table 3: Comparing the original graph to the non-3-colorable subgraph expressed by the certificate. 

An overall analysis of these computational experiments shows that NulLA performs best on 
sparse graphs. For example, the 3-Insertions_5 . col graph (with 1,406 nodes and 9,695 edges) 
runs in 83 seconds, while the 3-FullIns_5 . col graph (with 2,030 nodes and 33,751 edges) runs in 
15027 seconds. Another example is pJiat700-2 . clq (with 700 nodes and 121,728 edges) and 
willl99GPIA. col (with 701 nodes and 7,065 edges). NulLA proved the non-3-colorability of 
willl99GPIA. col in 35 seconds, while p_hat700-2 . clq took 30115 seconds. 

Finally, as an informal measure of the distribution of degree one certificates, we generated 
random graphs of 16 nodes with edge probability .27. We selected this probability because it 
lies on the boundary between feasible and infeasible instances. In other words, graphs with edge 
probability less than .27 were almost always 3-colorable, and graphs with edge probability greater 
than .27 were almost always non-3-colorable. However, we experimentally found that an edge 
probability of .27 created a distribution that was almost exactly half and half. Of 100 trials, 48 
were infeasible. Of those 48 graphs, 40 had degree one certificates and 8 had degree four certificates. 
Of these remaining 8 instances, we were able to find degree one certificates for all 8 by appending 
degree-cutters or by finding alternative Nullstellensatz certificates. This tentative measure indicates 
that non-3-colorability certificates of degrees greater than one may be rare. 
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Graph 


vertices 


edges 


rows 


cols 


deg 


sec 


milesSOO.col 


128 


2,340 


143,640 


299,521 


1 


1.35 


mileslOOO.col 


128 


6,432 


284,042 


823,297 


1 


7.52 


mileslSOO.col 


128 


10,396 


349,806 


1,330,689 


1 


24.23 


mulsol.i.5.col 


197 


3,925 


606,959 


773,226 


1 


6 


zeroin.i.l.col 


211 


4,100 


643,114 


865,101 


1 


6 


quccnl6_16.col 


256 


12,640 


1,397,473 


3,235,841 


1 


106 


hainming8-4.clq 


256 


20,864 


2,657,025 


5,341,185 


1 


621.1 


school! _nsh. col 


352 


14,612 


4,051,202 


5,143,425 


1 


210.74 


MANN.a27.clq 


378 


70,551 


9,073,144 


26,668,279 


1 


9809.22 


brock400_4.clq 


400 


59,765 


10,579,085 


23,906,001 


1 


4548.59 


gen400_p0.9_65.clq 


400 


71,820 


10,735,248 


28,728,001 


1 


9608.85 


le450_5d.col 


450 


9,757 


4,168,276 


4,390,651 


1 


304.84 


fpsol2.i.l.col 


496 


11,654 


4,640,279 


57,803,85 


1 


93.8 


C500.9.clq 


500 


112,332 


20,938,304 


56,166,001 


1 


72752 


homer, col 


561 


3,258 


1,189,065 


1,827,739 


1 


8 


p_hat700-2.clq 


700 


121,728 


48,301,632 


85,209,601 


1 


30115 


wilUggGPIA.col 


701 


7,065 


5,093,201 


4,952,566 


1 


35 


inithx.i.l.col 


864 


18,707 


13,834,511 


16,162,849 


1 


1021.76 


qg.order30.col 


900 


26,100 


23,003,701 


23,490,001 


1 


13043 


wap06a.col 


947 


43,571 


37,703,503 


41,261,738 


1 


1428 


dsjclOOO.l.col 


1,000 


49,629 


45,771,027 


49,629,001 


1 


2981.91 


5-FullIns_4.col 


1,085 


11,395 


13,149,910 


12,363,576 


1 


200.09 


3-FuUIns_5.col 


2,030 


33,751 


70,680,086 


68,514,531 


1 


15027.9 w 4/i 



Table 4: Graphs with 4-cliques. 

5 Conclusion 

We presented a general algebraic method to prove combinatorial infeasibility. We show that even 
though the worst-case known NuUstellensatz degree upper bounds are doubly-exponential, in prac- 
tice for useful combinatorial systems, they are often much smaller and can be used to solve even 
large problem instances. Our experimental results illustrated that many benchmark non-3-colorable 
graphs have degree one certificates; indeed, non-3-colorable graphs with certificate degrees larger 
than one appear to be rare. 
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